Information processing apparatus and information processing method

ABSTRACT

There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

CROSS REFERENCE TO PRIOR APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/564,883 (filed on Oct. 6, 2017), which is a National Stage PatentApplication of PCT International Patent Application No.PCT/JP2016/065865 (filed on May 30, 2016) under 35 U.S.C. § 371, whichclaims priority to Japanese Patent Application No. 2015-119360 (filed onJun. 12, 2015), which are all hereby incorporated by reference in theirentirety.

TECHNICAL FIELD

The present disclosure relates to an information processing apparatusand an information processing method, and more particularly to aninformation processing apparatus and an information processing methodwhich are capable of reliably recognizing the position on a screen of animage made up of a plurality of divided images or the positions on thescreen of divided images compatible with encoded streams.

BACKGROUND ART

In recent years, OTT-V (Over The Top Video) has become mainstream in thestreaming services on the Internet. One technique that has started tocome into wide use as the fundamental technology for OTT-V is MPEG-DASH(Moving Picture Experts Group phase-Dynamic Adaptive Streaming over HTTP(HyperText Transfer Protocol)) (see, for example, NPL 1).

According to MPEG-DASH, a distribution server provides encoded streamshaving different bit rates for one moving-image content, and a playbackterminal demands encoded streams having an optimum bit rate, therebyrealizing adaptive streaming distribution.

MPEG-DASH SRD (Spatial Relationship Description) extension defines SRDindicating the position on a screen of one or more individually encodedregions into which an image of a moving-image content has been divided(see, for example, NPLs 2 and 3). The SRD makes it possible to realize aROI (Region of Interest) function of spatial adaptation for selectivelyacquiring an encoded stream of an image of a desired regions, using abitrate adaptation method for selectively acquiring encoded streamshaving desired bit rates.

Images of moving-image contents include not only images captured throughangles of field by a single camera, but also entire celestial sphereimages where images captured horizontally around 360° or verticallyaround 180° are mapped onto 2D (Two-Dimensional) images (planar images),and panoramic images captured horizontally around 360°. For example, ifan entire celestial sphere image is to be divided horizontally intothree or more regions and the regions are to be encoded, then since theregions at both horizontal ends represent contiguous images, they can beencoded as one image.

However, inasmuch as the positions on the screen of the regions at bothends are discrete, there are a plurality of positions on the screen ofobjects to be encoded. According to MPEG-DASH, therefore, the positionson the screen of the regions at both ends cannot be described using anSRD. In other words, an SRD is unable to describe the position on ascreen of an image made up of a plurality of divided images compatiblewith encoded streams.

According to an SRD, the positions on a screen of respective regions andpositions on images compatible with encoded streams are described asidentical to each other. Therefore, if the positions on a screen ofrespective regions and positions on images compatible with encodedstreams are different from each other, the positions on the screen ofthe respective regions cannot be described using the SRD. In otherwords, if the positions on the screen of respective divided images thatmake up an image and positions on images compatible with encoded streamsare different from each other, then an SRD is unable to describe thepositions on the screen of the respective divided linages.

CITATION LIST Patent Literature

[NPL 1]

MPEG-DASH (Dynamic Adaptive Streaming over HTTP) (URL:http://mpeg.chiariglione.org/standards/mpeg-dash/media-presentation-description-and-segment-formats/text-isoiec-23009-12012-dam-1)

[NPL 2]

“Text of ISO/IEC 23009-1:2014 FDAM 2 Spatial Relationship Description,Generalized URL parameters and other extensions,” N15217, MPEG111,Geneva, February 2015

[NPL 3]

“WD of ISO/IEC 23009-3 2 nd edition AMD 1 DASH ImplementationGuidelines,” N14629. MPEG109, Sapporo, July 2014

SUMMARY Technical Problem

Therefore, it has been desirous of reliably describing the position on ascreen of an image made up of a plurality of divided images or thepositions on a screen of divided images compatible with encoded streams,so that they can be recognized.

The present disclosure has been made under the circumstances describedabove, and is aimed at reliably recognizing the position on a screen ofan image made up of a plurality of divided images or the positions on ascreen of divided images compatible with encoded streams.

Solution to Problem

An information processing apparatus according to a first aspect of thepresent disclosure is an information processing apparatus including asetting section that sets a position protruding out of a screen as aposition on the screen of an image made up of a plurality of dividedimages compatible with encoded streams.

An information processing method according to the first aspect of thepresent disclosure corresponds to the information processing apparatusaccording to the first aspect of the present disclosure.

According to the first aspect of the present disclosure, a positionprotruding out of a screen is set as a position on the screen of animage made no of a plurality of divided images compatible with encodedstreams.

An information processing apparatus according to a second aspect of thepresent disclosure is an information processing apparatus including anallocator that places an image obtained by decoding encoded streams on ascreen, on the basis of a position protruding oat of the screen which isset as a position on the screen of the image which is made up of aplurality of divided images compatible with the encoded streams.

An information processing method according to the second aspect of thepresent disclosure corresponds to the information processing apparatusaccording to the second aspect of the present disclosure.

According to the second aspect of the present disclosure, an imageobtained by decoding encoded streams is placed on a screen on the basisof a position protruding out of the screen which is set as a positron onthe screen of the image which is made up of a plurality of dividedimages compatible with the encoded streams.

An information processing apparatus according to a third aspect of thepresent disclosure is an information processing apparatus including asetting section that sets positions on a screen of respective dividedimages of an image which is made up of a plurality of divided imagescompatible with encoded streams, in association with positions of thedivided images on the image.

An information processing method according to the third aspect of thepresent disclosure corresponds to the information processing apparatusaccording to the third aspect of the present disclosure.

According to the third aspect of the present disclosure, positions on ascreen of respective divided images of an image which is made up of aplurality of divided images compatible with encoded streams are set inassociation with positions of the divided images on the image.

An information processing apparatus according to a fourth aspect of thepresent disclosure is an information processing apparatus including anallocator that places divided images of an image obtained by decodingencoded streams on a screen, on the basis of positions on the screen ofthe divided images of the image which are set in association withpositions on the image which is made up of a plurality of divided imagescompatible with the encoded streams.

An information processing method according to the fourth aspect of thepresent disclosure corresponds to the information processing apparatusaccording to the fourth aspect of the present disclosure.

According to the fourth aspect of the present disclosure, divided imagesof an image obtained by decoding encoded streams are placed on a screenon the basis of positions on the screen of the divided images of theimage which are set in association with positions on the image which ismade up of a plurality of divided images compatible with the encodedstreams.

The information processing apparatus according to the first throughfourth aspects can be implemented by a computer when it executesprograms.

In order to implement the information processing apparatus according tothe first through fourth aspects, the programs to be executed by thecomputer can be provided by being transmitted through a transmissionmedium or recorded on a recording medium.

Advantageous Effects of Invention

According to the first aspect of the present disclosure, information canbe set. According to the first aspect of the present disclosure,information can be set in a manner to be able to reliably recognize theposition on a screen of an image made up of a plurality of dividedimages compatible with encoded streams.

According to the second aspect of the present disclosure, informationcan be acquired. According to the second aspect of the presentdisclosure, the position on a screen of an image made up of a pluralityof divided images compatible with encoded streams can reliably berecognized.

According to the third aspect of the present disclosure, information canbe set. According to the third aspect of the present disclosure,information can be set in a manner to be able to reliably recognizepositions on a screen of divided images of an image compatible withencoded streams.

According to the fourth aspect of the present disclosure, informationcan be acquired. According to the fourth aspect of the presentdisclosure, positrons on a screen of divided images of an imagecompatible with encoded screams can be reliably recognized.

The advantages described above are not necessarily restrictive innature, but any of the advantages described in the present disclosureare applicable.

BRIEF INSCRIPTION OF DRAWINGS

FIG. 1 is a block diagram depicting a configurational example of a firstembodiment of an information processing system to which the presentdisclosure is applied.

FIG. 2 is a block diagram depicting a configurational example of animage file generator of a file generating apparatus depicted in FIG. 1.

FIG. 3 is a diagram illustrative of an encoded stream of an entirecelestial sphere image.

FIG. 4 is a diagram illustrative of an example of definition of an SRDin the first embodiment.

FIG. 5 is a diagram illustrative of another example of definition of anSRD in the first embodiment.

FIG. 6 is a diagram depicting an SRD of an end image described in an MPD(Media Presentation Description; file.

FIG. 7 is a diagram illustrative of an example of definition of an SRD.

FIG. 8 is a diagram illustrative of an example of an MPD file in thefirst embodiment.

FIG. 9 is a flowchart of an encoding process of the image file generatordepicted in FIG. 2.

FIG. 10 is a block diagram depicting a configurational example of astreaming player implemented by a moving-image playback terminaldepicted in FIG. 1.

FIG. 11 is a flowchart of a playback process of the streaming playerdepicted in FIG. 10.

FIG. 12 is a diagram depicting an example of the segment structure of animage file of an end image in a second embodiment of the informationprocessing system to which the present disclosure is applied.

FIG. 13 is a diagram depicting an example of Tile Region Group Entry inFIG. 12.

FIG. 14 is a diagram depicting an example of an MPD file in the secondembodiment.

FIG. 15 is a diagram depicting an example of a track structure.

FIG. 16 is a diagram depicting another example of an leva box in thesecond embodiment.

FIG. 17 is a diagram depicting another example of an MPD file in thesecond embodiment.

FIG. 18 is a block diagram depicting a configurational example of athird embodiment of the information processing system to which thepresent disclosure is applied.

FIG. 19 is a block diagram depicting a configurational example of a filegenerating apparatus depicted in FIG. 18.

FIG. 20 is a diagram depicting an example of a mosaic image.

FIG. 21 is a diagram depicting an example of an sgpd box and an leva boxin the third embodiment.

FIG. 22 is a diagram depicting a first example of an MPD file in thethird embodiment.

FIG. 23 is a diagram depicting a second example of an MPD file in thethird embodiment.

FIG. 24 is a diagram depicting an example of a screen where thumbnailimages are placed.

FIG. 25 is a flowchart of a file generating process of the filegenerating apparatus depicted in FIG. 19.

FIG. 26 is a block diagram depicting a configurational example of astreaming player implemented by a moving-image playback terminaldepicted in FIG. 18.

FIG. 27 is a diagram illustrative of an outline of a playback process ofthe streaming player depicted in FIG. 26.

FIG. 28 is a flowchart of the playback process of the streaming playerdepicted in FIG. 26.

FIG. 29 is a block diagram depicting a configurational example of thehardware of a computer.

DESCRIPTION OF EMBODIMENTS

Modes (hereinafter referred to as “embodiments”) for carrying out thepresent disclosure will be described below. The description will begiven in the following order.

1. First embodiment: Information processing system (FIGS. 1 through 11)

2. Second embodiment: Information processing system (FIGS. 12 through17)

3. Third embodiment: Information processing system (FIGS. 18 through 28)

4. Fourth embodiment: Computer (FIG. 29)

First Embodiment Configurational Example of a First Embodiment of anInformation Processing System

FIG. 1 is a block diagram depicting a configurational example of a firstembodiment of an information processing system to which the presentdisclosure is applied.

An information processing system 10 depicted in FIG. 1 includes a Webserver 12 connected to a file generating apparatus 11, and amoving-image playback terminal 14, the Web server 12 and themoving-image playback terminal 14 being connected to each other over theInternet 13.

In the information processing system 10, the Web server 12 distributesencoded streams of an entire celestial sphere image as an image of amoving-image content to the moving-image playback terminal 14 accordingto a process equivalent to MPEG-DASH.

In the present specification, the entire celestial sphere image refersto an image according to equidistant cylindrical projection for spheres,where an image captured horizontally around 360° or vertically around180° (hereinafter referred to as “omnidirectional image”) is mapped ontoa spherical plane. However, the entire celestial sphere image may be animage representing a development of a cube, where an omnidirectionalimage is mapped onto the cube.

The file generating apparatus 11 (information processing apparatus) ofthe information processing system 10 encodes a low-resolution entirecelestial sphere image to generate a low-resolution encoded stream. Thefile generating apparatus 11 also independently encodes images dividedfrom a high-resolution entire celestial sphere image to generatehigh-resolution encoded streams of the respective divided images. Thefile generating apparatus 11 generates image files by converting thelow-resolution encoded stream and the high-resolution encoded streamsinto files each per time unit called “segment” ranging from several toten seconds. The file generating apparatus 11 uploads the generatedimage files to the Web server 12.

The file generating apparatus 11 (setting section) also generates an MPDfile (management file) for managing image files, etc. The filegenerating apparatus 11 uploads the MPD file to the Web server 12.

The Web server 12 stores the image files and the MPD file uploaded fromthe file generating apparatus 11. In response to a request from themoving-image playback terminal 14, the Web server 12 sends the imagefiles, the MPD file, etc. that have been stored therein to themoving-image playback terminal 14.

The moving-image playback terminal 14 executes software 21 forcontrolling streaming data (hereinafter referred to as “controlsoftware”), moving-image playback software 22, and client software 23for accessing HTTP (HyperText Transfer Protocol) (hereinafter referredto as “access software”), etc.

The control software 21 is software for controlling data streaming fromthe Web server 12. Specifically, the control software 21 enables themoving-image playback terminal 14 to acquire the MPD file from the Webserver 12.

Based on the MPD file, the control software 21 instructs the accesssoftware 23 to send a request for sending encoded streams to be playedwhich are designated by the moving-image playback software 22.

The moving-image playback software 22 is software for playing theencoded streams acquired from the Web server 12. Specifically, themoving-image playback software 22 indicates encoded streams to be playedto the control software 21. Furthermore, when the moving-image playbacksoftware 22 receives a notification of having started receiving streamsfrom the access software 23, the moving-image playback software 22decodes the encoded streams received by the moving-image playbackterminal 14 into image data. The moving-image playback software 22combines the decoded image data and outputs the combined image data.

The access software 23 is software for controlling communication withthe Web server 12 over the internet 13 using HTTP. Specifically, inresponse to the instruction from the control software 21, the accesssoftware 23 controls the moving-image playback terminal 14 to send arequest for sending encoded streams to be played that are included inimage files. The access software 23 also controls the moving-imageplayback terminal 14 to start receiving she encoded streams that aresent from the Web server 12 in response to the request, and supplies anotification of having started receiving streams to the moving-imageplayback software 22.

Configurational Example of an Image File Generator

FIG. 2 is a block diagram depicting a configurational example of animage file generator for generating image files, of the file generatingapparatus 11 depicted in FIG. 1.

As depicted in FIG. 2, an image file generator 150 includes a stitchingprocessor 151, a mapping processor 152, a resolution downscaler 153, anencoder 154, a divider 155, encoders 156-1 through 156-4, a storage 157,and a generator 158.

The stitching processor 151 equalizes the colors and lightnesses ofomnidirectional images supplied from muiti-cameras, not depicted, andjoin them while removing overlaps. The stitching processor 151 suppliesan omnidirectional image obtained as a result to the mapping processor152.

The mapping processor 152 maps the omnidirectional image supplied fromthe stitching processor 151 onto a sphere, thereby generating an entirecelestial sphere image. The mapping processor 152 supplies the entirecelestial sphere image to the resolution downscaler 153 and the divider155. The stitching processor 151 and the mapping processor 152 may beintegrated with each other.

The resolution downscaler 153 reduces the horizontal and verticalresolutions of the entire celestial sphere image supplied from themapping processor 152 to one-half, thereby downscaling the resolution ofthe image and generating a low-resolution entire celestial sphere image.The resolution downscaler 153 supplies the low-resolution entirecelestial sphere image to the encoder 154.

The encoder 154 encodes the low-resolution entire celestial sphere imagesupplied from the resolution downscaler 153 according to an encodingprocess such as AVC (Advanced video Coding), HEV (High Efficiency VideoCoding), or the like, thereby generating a low-resolution encodedstream. The encoder 154 supplies the low-resolution encoded stream tothe storage 157, which records the supplied low-resolution encodedstream therein.

The divider 155 divides the entire celestial sphere image supplied as ahigh-resolution entire celestial sphere image from the mapping processor152 vertically into three regions, and divides the central regionhorizontally into three regions such that no boundary lies at thecenter. The divider 155 downscales the resolution of the upper and lowerregions among the five divided regions such that the horizontalresolution is reduced to one-half, for example.

The divider 155 supplies a low-resolution upper image, which representsthe upper region whose resolution has been downscaled, to the encoder156-1, and supplies a low-resolution lower image, which represents thelower region whose resolution has been downscaled, to the encoder 156-2.

The divider 155 combines the left end of the left end region of thecentral region with the right end of the right end region thereof,thereby generating an end image. The divider 155 supplies the end imageto the encoder 156-3. The divider 155 also supplies the central one ofthe central region as a central image to the encoder 156-4.

The encoders 156-1 through 156-4 encode the low-resolution upper image,the low-resolution lower image, the end image, and the central imagesupplied from the divider 155, according to an encoding process such asAVC, HEVC, or the like. The encoders 156-1 through 156-4 supply encodedstreams thus generated as high-resolution streams to the storage 157,which records the supplied high-resolution streams therein.

The storage 157 records therein the single low-resolution encoded streamsupplied from the encoder 154 and the four high-resolution encodedstreams supplied from the encoders 156-1 through 156-4.

The generator 158 reads the single low-resolution encoded stream and thefour high-resolution encoded streams from the storage 157, and convertseach of them into files each per segment. The generator 158 transmitsthe image files thus generated to the Web server 12 depicted in FIG. 1.

Description of an Encoded Stream of an Entire Celestial Sphere Image

FIG. 3 is a diagram illustrative of an encoded stream of an entirecelestial sphere linage.

If the resolution of an entire celestial sphere image 170 is 4 k (3840pixels×2160 pixels), as depicted in FIG. 3, then the horizontalresolution of a low-resolution entire celestial sphere image 161 is 1920pixels that is one-half of the horizontal resolution of the entirecelestial sphere image 170, and the vertical resolution of thelow-resolution entire celestial sphere image 161 is 1080 pixels that isone-half of the vertical resolution of the entire celestial sphere image170, as depicted in FIG. 3 at A. The low-resolution entire celestialsphere image 161 is encoded as it is, generating a single low-resolutionencoded stream.

As depicted in FIG. 3 at B, the entire celestial sphere image 170 isdivided vertically into three regions, and the central region thereof isdivided horizontally into three regions such that no boundary lies atthe center O. As a result, the entire celestial sphere image 170 isdivided into an upper image 171 as the upper region of 3840 pixels×540pixels, a lower image 172 as the lower region of 3840 pixels×540 pixels,and the central region of 3840 pixels×1080 pixels. The central region of3840 pixels×1080 pixels is divided into a left end image 173-1 as theleft region of 960 pixels×1080 pixels, a right end image 173-2 as theright region of 960 pixels×1080 pixels, and a central image 174 as thecentral region of 1920 pixels×1080 pixels.

The upper image 171 and the lower image 172 have their horizontalresolution reduced to one-half, generating a low-resolution upper imageand a low-resolution lower image. Since the entire celestial sphereimage is an image that spreads horizontally and vertically through 360degrees, the left end image 173-1 and the right end image 173-2 thatface each other are actually continuous images. The left end of the leftend image 173-1 is combined with the right end of the right end image173-2, generating an end image. The low-resolution upper image, thelow-resolution lower image, the end image, and the central image 174 areencoded independently of each other, generating four high-resolutionencoded streams.

Generally, the entire celestial sphere image 170 is generated such thatthe front of the entire celestial sphere image 170 at a position on theentire celestial sphere image 170 that is located at the center of thefield of view in the standard direction of sight lies at the center O ofthe entire celestial sphere image 170.

According to an encoding process such as AVC, HEVC, or the like whereinformation is compressed by temporal motion compensation, when asubject moves on a screen, the appearance of a compression distortion ispropagated between frames while being kept in a certain shape. However,if a screen is divided and the divided images are encoded independentlyof each other, then since motion compensation is not carried out acrossboundaries, a compression distortion tends to increase. As a result, amoving image made up of decoded divided images has a stripe generatedtherein where the appearance of a compression distortion varies at theboundaries between the divided images. This phenomenon is known to occurbetween slices of AVC or tiles of HEVC. Therefore, image quality islikely to deteriorate at the boundaries between the low-resolution upperimage, the low-resolution lower image, the end image, and the centralimage 174 that have been decoded.

Consequently, the entire celestial sphere image 170 is divided such thatno boundary lies at the center O of the entire celestial sphere image170 which it is highly possible for the user to see. As a result, imagequality does not deteriorate at the center O which it is highly possiblefor the user to see, making any image quality deterioration unobtrusivein the entire celestial sphere image 170 that has been decoded.

The left end image 173-1 and the right end image 173-2 are combined witheach other and encoded. Therefore, if the areas of the end images andthe central image 174 are the same, then a maximum of high-resolutionencoded streams of an entire celestial sphere image from a givenviewpoint which are required to display the entire celestial sphereimage are two high-resolution encoded streams of either one of thelow-resolution upper image and the low-resolution lower image and eitherone of the end image and the central image 174, independently of theviewpoint. Therefore, the number of high-resolution streams to bedecoded by the moving-image playback terminal 14 is the sameindependently of the viewpoint.

Description of the Definition of an SRD in the First Embodiment

FIG. 4 is a diagram illustrative of an example of definition of an SRDin the first embodiment.

An SRD refers to information that can be described in an MPD file, andrepresents information indicating the position on a screen of one ormore individually encoded regions into which an image of a moving-imagecontent has been divided.

Specifically, an SRD is given as <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2015” value= “source_id, object_x,object_y, object_width, object_height, total_width, total_height,spatial_set_id”/>.

“source_id” refers to the ID (identifier) of a moving-image contentcorresponding to the SRD. “object_z” and “object_y” refer respectivelyto the horizontal and vertical coordinates on a screen of an upper leftcorner of a region, corresponding to the SRD. “object_width” and“object_height” refer respectively to the horizontal and vertical sizesof the region corresponding to the SRD. “total_width” and “total_height”refer respectively to the horizontal and vertical sizes of a screenwhere the region corresponding to the SRD is placed.

“spatial_set_id” refers to the ID of the screen where the regioncorresponding to she SRD is placed.

As depicted in FIG. 4, according to the definition of SRD in the presentembodiment, if an image of a moving-image content is a panoramic image(panorama image) or an entire celestial sphere image (celestial spheredynamic), then the sum of “object_z” and “object_width” may exceed“total_width,” and the sum of “object_y” and “object_height” may exceed“total_height.”

Information indicating that an usage of a moving-image content is apanoramic image (panorama image) or an entire celestial sphere image(celestial sphere dynamic) may be described in an MPD file. In thiscase, the definition of SRD in the present embodiment is depicted inFIG. 5.

Description of an SBD of an End Image

FIG. 6 is a diagram depicting an SRD of an end image described in an MPDfile.

As described above with reference to FIG. 4, according to the SRD in thefirst embodiment, if an image of a moving-image content is an entirecelestial sphere image, then the sum of “object_x” and “object_width”may exceed “total_width.”

Therefore, the file generating apparatus 11 sets the position of theleft end image 173-1 on a screen 180 to the right side of the right endimage 173-2, for example. As depicted in FIG. 6, the position of theleft end image 173-1 on the screen 180 now protrudes oat of the screen180. However, the positions on the screen 180 of the right end image173-2 and the left end image 173-1 that make up the end image 173 arerendered contiguous. Consequently, the file generating apparatus 11 candescribe the position of the end image 173 on the screen 180 with anSRD.

Specifically, the file generating apparatus 11 describes the horizontaland vertical coordinates of the position on the screen 180 of an upperleft corner of the right end image 173-2 as “object_x” and “object_y” ofthe SRD of the end image 173, respectively. The file generatingapparatus 11 also describes the horizontal and vertical sizes of the endimage 173 as “object_width” and “object_height” of the SRD of the endimage 173, respectively.

The file generating apparatus 11 also describes the horizontal andvertical sizes of the screen 180 as “total_width” and “total_height” ofthe SRD of the end image 173, respectively. The file generatingapparatus 11 thus sets the position protruding out of the screen 180 asthe position of the end image 173 on the screen 180.

By contrast, if the definition of an SRD is limited such that the sum of“object_x” and “object_width” is equal to or smaller than “total_width”and the sum of “object_y” and “object_height” is equal to or smallerthan “total_height,” as depicted in FIG. 7, i.e., if the position on thescreen of the region corresponding to the SRD is inhibited fromprotruding out of the screen, then the position of the left end image173-1 on the screen 180 cannot be set to the right side of the right endimage 173-2.

Therefore, the positions on the screen 180 of the right end image 173-2and the left end image 173-1 that make up the end image 173 are notcontiguous, and the positions on the screen 180 of both the right endimage 173-2 and the left end image 173-1 need to be described as theposition of the end image 173 on the screen 180. As a consequence, thepositron of the end image 173 on the screen 180 cannot be described byan SRD.

Example of an MPD File

FIG. 8 is a diagram illustrative of an example of an MPD file generatedby the file generating apparatus 11 depicted in FIG. 1.

As depicted in FIG. 8, in the MPD file, “AdaptationSet” is described perencoded stream. Each “AdaptationSet” has the SRD of the correspondingregion described therein and “Representation” described therein.“Representation” has information, such as the URL (Uniform ResourceLocator) of the image file of the corresponding encoded stream,described therein.

Specifically, the first “AdaptationSet” in FIG. 8 is the “AdaptationSet”of a low-resolution encoded stream of the low-resolution entirecelestial sphere image 161 of the entire celestial sphere image 170.Therefore, the first “AdaptationSet” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,0,0,1920,1080,1920,1080,1”/> that represents the SRD of thelow-resolution entire celestial sphere image 161 described therein. The“Representation” of the first “AdaptationSet” has the URL “stream1.mp4”of the image file of the low-resolution encoded stream describedtherein.

The second “AdaptationSet” in FIG. 8 is the “AdaptationSet” of ahigh-resolution encoded stream of the low-resolution upper image of theentire celestial sphere image 170. Therefore, the second “AdaptationSet”has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,0,0,3840,540,3840,2160,2”/> that represents the SRD of thelow-resolution upper image described therein. The “Representation” ofthe second “AdaptationSet” has the URL “stream2.mp4” of the image fileof the high-resolution encoded stream of the low-resolution upper imagedescribed therein.

The third “AdaptationSet” in FIG. 8 is the “AdaptationSet” of ahigh-resolution encoded stream of the central image 174 of the entirecelestial sphere image 170. Therefore, she third “AdaptationSet” has<SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,960,540,1920,1080,3840,2160,2”/> that represents the SRD of thecentral image 174 described therein. The “Representation” of the third“AdaptationSet” has the URL “stream3.mp4” of the image file of thehigh-resolution encoded stream of the central image 174 describedtherein.

The fourth “AdaptationSet” in FIG. 8 as the “AdaptationSet” of ahigh-resolution encoded stream of the low-resolution lower image of theentire celestial sphere image 170. Therefore, the fourth “AdaptationSet”has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,0,1620,3840,540,3840,2160,2”/> that represents the SRD of thelow-resolution lower image described therein. The “Representation” ofthe fourth “AdaptationSet” has the URL “stream4.mp4” of the image fileof the high-resolution encoded stream of the low-resolution lower imagedescribed therein.

The fifth “AdaptationSet” in FIG. 8 is the “AdaptationSet” of ahigh-resolution encoded stream of the end image 173 of she entirecelestial sphere image 170. Therefore, the fifth “AdaptationSet” has<SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,2880,540,1920,1080,3840,2160,2”/> that represents the SRD ofthe end image 173, described therein. The “Representation” of the fifth“AdaptationSet” has the URL “stream5.mp4” of the image file of thehigh-resolution encoded stream of the end image 173 described therein.

Description of a Process of the Image File Generator

FIG. 9 is a flowchart of an encoding process of the image file generator150 depicted in FIG. 2.

In step S11 depicted in FIG. 9, the stitching processor 151 equalizesthe colors and lightnesses of omnidirectional images supplied from themulti-cameras, not depicted, and join them while removing overlaps. Thestitching processor 151 supplies an omnidirectional image obtained as aresult to the mapping processor 152.

In step S12, the mapping processor 152 generates an entire celestialsphere image 170 from the omnidirectional image supplied from thestitching processor 151, and supplies the entire celestial sphere image170 to the resolution downscaler 153 and the divider 155.

In step S13, the resolution downscaler 153 downscales the resolution ofthe entire celestial sphere image 170 supplied from the mappingprocessor 152, generating a low-resolution entire celestial sphere image161. Tins resolution downscaler 153 supplies the low-resolution entirecelestial sphere image 161 to the encoder 154.

In step S14, the encoder 154 encodes the low-resolution entire celestialsphere image 161 supplied from the resolution downscaler 153, therebygenerating a low-resolution encoded stream. The encoder 154 supplies thelow-resolution encoded stream to the storage 157.

In step S15, the divider 155 divides the entire celestial sphere image170 supplied from the mapping processor 152 into an upper image 171, alower image 172, a left end image 173-1, a right end image 173-2, and acentral image 174. The divider 155 supplies the central image 174 to theencoder 156-4.

In step S16, the divider 155 downscales the resolution of the upperimage 171 and the lower image 172 such that their horizontal resolutionis reduced to one-half. The divider 155 supplies a low-resolution upperimage obtained as a result to the encoder 156-1 and also supplies alow-resolution lower image, which represents the lower region whoseresolution has been downscaled, to the encoder 156-2.

In step S17, the divider 155 combines the left end of the left end image173-1 with the right end of the right end image 173-2, therebygenerating an end image 173. The divider 155 supplies the end image 173to the encoder 156-3.

In step S18, the encoders 156-1 through 156-4 encode the low-resolutionupper image, the low resolution lower image, the end image 173, and thecentral image 174, respectively, supplied from the divider 155. Theencoders 156-1 through 156-4 supply encoded streams generated as aresult as high-resolution streams to the storage 157.

In step S19, the storage 157 records therein the single low-resolutionencoded stream supplied from the encoder 154 and the fourhigh-resolution encoded streams supplied from the encoders 156-1 through156-4.

In step 520, the generator 158 reads the single low-resolution encodedstream and the four high-resolution encoded streams from the storage157, and converts each of them into files each per segment, therebygenerating image files. The generator 158 transmits the image files tothe Web server 12 depicted in FIG. 1. The encoding process is now ended.

Functional Configurational Example of a Moving-Image Playback Terminal

FIG. 10 is a block diagram depicting a configurational example of astreaming player that is implemented by the moving-image playbackterminal 14 depicted in FIG. 1 when it executes the control software 21,the moving-image playback software 22, and the access software 23.

The streaming player 190 depicted in FIG. 10 includes an MPD acquirer191, an MPD processor 192, an image file acquirer 193, decoders 194-1through 194-3, an allocator 195, a renderer 196, and a line-of-sightdetector 197.

The MPD acquirer 191 of the streaming player 190 acquires an MPD filefrom the Web server 12, and supplies the MPD file to the MPD processor192.

Based on the direction of sight of the user supplied from theline-of-sight detector 197, the MPD processor 192 selects two of theupper image 171, the lower image 172, the end image 173, and the centralimage 174 as selected images that may possibly be included in the fieldof view of the user. Specifically, when the entire celestial sphereimage 170 is mapped onto a spherical plane, the MPD processor 192selects one of the upper image 171 and the lower image 172 and one ofthe end image 173 and the central image 174 which may be possiblyincluded in the field of view of the user when the user that existswithin the sphere looks along the direction of sight, as selectedimages.

The MPD processor 192 extracts information such as URLs of the imagefiles of the low-resolution entire celestial sphere image 161 and theselected images in the segments to be played, from the MPD file suppliedfrom the MPD acquirer 191, and supplies the extracted information to theimage file acquirer 193. The MPD processor 192 also extracts the SRDs ofthe low-resolution entire celestial sphere image 161 and the selectedimages in the segments to be played, from the MPD file, and supplies theextracted SRDs to the allocator 195.

The image file acquirer 193 requests the Web server 12 for the encodedstreams or the image files that are specified by the URLs supplied fromthe MPD processor 192, and acquires the encoded streams. The image fileacquirer 193 supplies the acquired love-resolution encoded stream to thedecoder 194-1. The image file acquirer 193 also supplies thehigh-resolution encoded stream of one of the selected images to thedecoder 194-2, and supplies the high-resolution encoded stream of theother selected image to the decoder 194-3.

The decoder 194-1 decodes the low-resolution encoded stream suppliedfrom, the image file acquirer 193 according to a process correspondingto an encoding process such as AVC, HEVC, or the like, and supplies thelow-resolution entire celestial sphere image 161 obtained as a result ofthe decoding process to the allocator 195.

The decoders 194-2 and 194-3 decode the high-resolution encoded streamsof the selected images supplied, from the image file acquirer 193according to a process corresponding to an encoding process such as AVC,HEVC, or the like. The decoders 194-2 and 194-3 then supply the selectedimages obtained as a result of the decoding process to the allocator195.

The allocator 195 places the low-resolution entire celestial sphereimage 161 supplied from the decoder 194-1 on the screen on the basis ofthe SRD supplied from the MPD processor 192. Thereafter, the allocator195 superposes the selected images supplied from the decoders 194-2 and194-3 on the screen where the low-resolution entire celestial sphereimage 151 has been placed, on the basis of the SRD.

Specifically, the horizontal and vertical sizes of the screen where thelow-resolution entire celestial sphere image 161 indicated by the SRD isplaced are one-half of the horizontal and vertical sizes of the screenwhere the selected images are placed. Therefore, the allocator 195increases twice the horizontal and vertical sizes of the screen wherethe low-resolution entire celestial sphere image 161 is placed, andsuperposes the selected images thereon. The allocator 195 maps thescreen on which the selected images have been superposed onto a sphere,and supplies a spherical image obtained as a result to the renderer 196.

The renderer 196 projects the spherical image supplied from theallocator 195 onto the field of view of the user supplied from theline-of-sight detector 197, thereby generating an image in the field ofview of the user. The tenderer 196 then controls a display device, notdepicted, to display the generated image as a display image.

The line-of-sight detector 197 detects the direction of sight of theuser. The direction of sight of the user may be detected by a detectingmethod based on the gradient of a device worn by the user, for example.The line-of-sight detector 197 supplies the detected direction of sightof the user to the MPD processor 192.

The line-of-sight detector 197 also detects the position of the user.The position of the user may be detected by a detecting method, based ona captured image of a marker or the like that is added to a device wornby the user, for example. The line-of-sight detector 197 determines afield of view of the user based on the detected position of the user andthe line-of-sight vector, and supplies the determined field, of view ofthe user to the tenderer 196.

Description of a Process of the Moving-Image Playback Terminal

FIG. 11 is a flowchart of a playback process of the streaming player 190depicted in FIG. 10.

In step S41 depicted in FIG. 11, the MPD acquirer 191 of the streamingplayer 190 acquires the MPD file from the Web server 12 and supplies theacquired MPD file to the MPD processor 192.

In step S42, the MPD processor 192 selects two of the upper image 171,the lower image 172, the end image 173, and the central image 174 asselected images that may possibly be included in the field of view ofthe user, on the basis of the direction of sight of the user suppliedfrom the line-of-sight detector 197.

In step S43, the MPD processor 192 extracts information such as URLs ofthe image flies of the low-resolution entire celestial sphere image 161and the selected images in the segments to be played, from the MPD filesupplied from the MPD acquirer 191, and supplies the extractedinformation to the image file acquirer 193. In step S44, the MPDprocessor 192 extracts the SRDs of the low-resolution entire celestialsphere image 161 and the selected images in the segments to be played,from the MPD file, and supplies the extracted SRDs to the allocator 195.

In step S45, the image file acquirer 193 requests the Web server 12 forthe encoded streams of the image files that are specified by the URLssupplied from the MPD processor 192, and acquires the encoded streams.The image file acquirer 193 supplies the acquired low-resolution encodedstream to the decoder 194-1. The image file acquirer 193 also suppliesthe high-resolution encoded stream of one of the selected images to thedecode 194-2, and supplies the high-resolution encoded stream of theother selected image to the decoder 194-3.

In step S46, the decoder 194-1 decodes the low-resolution encoded streamsupplied from the image file acquirer 193, and supplies thelow-resolution entire celestial sphere image 161 obtained as a result ofthe decoding process to the allocator 195.

In step S47, the decoders 194-2 and 194-3 decode the high-resolutionencoded streams of the selected images supplied from the image fileacquirer 193, and supplies the selected images obtained as a result ofthe decoding process to the allocator 195.

In step S48, the allocator 195 places the low-resolution entirecelestial sphere image 151 supplied from the decoder 194-1 on the screenon the basis of the SRD supplied from the MPD processor 192. Thereafter,the allocator 195 superposes the selected images supplied from thedecoders 194-2 and 194-3 on the screen. The allocator 195 maps thescreen on which the selected images have bees superposed onto a sphere,and supplies a spherical image obtained as a result to the renderer 196.

In step S49, the renderer 196 projects the spherical image supplied fromthe allocator 195 onto the field of view of the user supplied from theline-of-sight detector 197, thereby generating an image to be displayed.The renderer 196 then controls the display device, not depicted, todisplay the generated image as a display image. The playback process isnow ended.

Second Embodiments Example of the Segment Structure of the Image File ofan End Image

According to a second embodiment of the image processing system to whichthe present disclosure is applied, different levels (to be described indetail later) are set for the encoded stream of the left end image 173-1and the encoded stream of the right end image 173-2, among the encodedstreams of the end image 173. As a consequence, if an SRD is defined asdepicted in FIG. 7, then the positions of the left end image 173-1 andthe right end image 173-2 on the screen 180 can be described using theSRD.

Specifically, the second embodiment of the image processing system towhich the present disclosure is applied is the same as the first,embodiment except the segment structure of the image file of the endimage 173 generated, by the file generating apparatus 11 and the MPDfile. Therefore, only the segment structure of the image file of the endimage 173 and the MPD file will be described below.

FIG. 12 is a diagram depicting an example of the segment structure ofthe image file of the end image 173 in the second embodiment of theinformation processing system to which the present disclosure isapplied.

As depicted in FIG. 12, in the image file of the end image 173, anInitial segment includes an ftyp box and an moov box. The moov boxincludes an stbl box and an mvex box placed therein.

The stbl box includes an sgpd box, etc. placed therein where Tile RegionGroup Entry indicating the position of the left end image 173-1 as partof the end image 173 on the end image 173 and Tile Region Group Entryindicating the position of the right end image 173-2 on the end image173 are successively described. Tile Region Group Entry is standardizedby HEVC Tile Track of HEVC File Format.

The mvex box includes an leva box, etc. placed therein where 1 is set asthe level for the left end image 173-1 corresponding to the first TileRegion Group Entry and 2 is set as the level for the right end image173-2 corresponding to the second Tile Region Group Entry.

The leva box sets 1 as the level for the left end image 173-1 and 2 asthe level for the right end image 173-2 by successively describinginformation of the level corresponding to the first Tile Region GroupEntry and information of the level corresponding to the second TileRegion Group Entry. The level functions as an index when part of anencoded stream is designated from an MPD file.

The leva box has assignment_type described therein that indicateswhether the object for which a level is to be set is an encoded streamplaced on a plurality of tracks or not as information of each level. Inthe example depicted in FIG. 12, the encoded stream of the end image 173is placed on one track. Therefore, the assignment_type is set to 0indicating that the object for which a level is to be set is not anencoded stream placed on a plurality of tracks.

The leva box also has the type of Tile Region Group Entry correspondingto the level described therein as information of each level. In theexample depicted in FIG. 12, “trif” representing the type of Tile RegionGroup Entry described in the sgpd box is described as information ofeach level. Details of the leva box are described in ISO/IEC 14496-12ISO base media file format 4th edition, July 2012, for example.

A media segment includes one or more subsegments including an sidx box,an ssix box, and pairs of moof and mdat boxes. The sidx box haspositional information placed therein which indicates the position ofeach subsequent in the image file. The ssix box includes positionalinformation of the encoded streams of respective levels placed in themdat boxes.

A subsegment is provided per desired time length. The mdat boxes haveencoded streams placed together therein for a desired time length, andthe moof boxes have management information of those encoded streamsplaced therein.

Example of Tile Region Group Entry

FIG. 13 is a diagram depicting an example of Tile Region Group Entry inFIG. 12.

Tile Region Group Entry describes successively therein the ID of theTile Region Group Entry, horizontal and vertical coordinates of an upperleft corner of the corresponding region on an image corresponding to theencoded stream, and horizontal and vertical sizes of the imagecorresponding to the encoded stream.

As depicted in FIG. 13, the end image 173 is made up of the right endimage 173-2 of 960 pixels×1080 pixels and the left end image 173-1 of960 pixels×1080 pixels whose left end is combined with the right end ofthe right end image 173-2. Therefore, the Tile Region Group Entry of theleft end image 173-1 is represented by (1,960,0,960,1080), and the TileRegion Group Entry of the right end image 173-2 is represented by(2,0,0,960,1080).

Example of an MPD File

FIG. 14 is a diagram depicting an example of an MPD file.

The MPD file depicted in FIG. 14 is the same as the MPD file depicted inFIG. 8 except for the fifth “AdaptationSet” which is the “AdaptationSet”of the high-resolution encoded stream of the end image 173. Therefore,only the fifth “AdaptationSet” will be described below.

The fifth “AdaptationSet” depicted in FIG. 14 does not have the SRD ofthe end image 173 described therein, but has “Representation” describedtherein. The “Representation” has the URL “stream5.mp4” of the imagefile of the high-resolution encoded stream of the end image 173described therein. Since a level is set for the encoded stream of theend image 173, “SubRepresentation” per level can be described in the“Representation.”

Therefore, the “SubRepresentation” of level “1” has<SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,2880,540,960,1080,3840,2160,2”/> which represents the SRD ofthe left end image 173-1 described therein. The SRD of the left endimage 173-1 is thus set in association with the position on the endimage 173 of the left end image 173-1 indicated by the Tile Region GroupEntry corresponding to level “1.”

The “SubRepresentation” of level “2” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0, 540, 960, 1080, 3340,2160, 2”/> which represents the SRD of the right end image 173-2described therein. The SRD of the right end image 173-2 is thus set inassociation with the position on the end image 173 of the right endimage 173-2 indicated by the Tile Region Group Entry corresponding tolevel “2.”

According to the second embodiment, as described above, different levelsare set for the left end image 173-1 and the right end image 173-2.Therefore, positions on the screen 180 of the left end image 173-1 andthe right end image 173-2 that make up the end image 173 correspondingto the encoded stream can be described by the SRD.

The streaming player 190 places the left end image 173-1 in she positionindicated by the Tile Region Group Entry corresponding to level “1” ofthe decoded end image 173, on the screen 180 on the basis of the SRD oflevel “1” set in the MPD file. The streaming player 190 also places theright end image 173-2 in the position indicated by the Tile Region GroupEntry corresponding to level “2” of the decoded end image 173, on thescreen 180 on the basis of the SRD of level “2” set in the MPD file.

According to the second embodiment, the encoded stream of the end image173 is placed on one track. However, if the left end image 173-1 and theright end image 173-2 are encoded as different tiles according to theHEVC process, then their respective slice data may be placed ondifferent tracks.

Example of a Track Structure

FIG. 15 is a diagram depicting an example of a track structure where theslice data of the left end image 173-1 and the right end image 173-2 areplaced on different tracks.

If the slice data of the left end image 173-1 and the right end image173-2 are placed on different tracks, then three tracks are placed inthe image file of the end image 173, as depicted in FIG. 15.

The track box of each track has Track Reference placed therein. TheTrack Reference represents reference relationship of a correspondingtrack to another track. Specifically, the Track Reference represents anID (hereinafter referred to as “track ID”) inherent in another track towhich the corresponding track has reference relationship. A sample ofeach track is managed by Sample Entry.

The track whose track ID is 1 is a base track that does not include theslice data of the encoded stream of the end image 173. Specifically, asample of the base track has parameter sets placed therein which includeVPS (Video Parameter Set), SPS (Sequence Parameter Set), SEI(Supplemental Enhancement Information), PPS (Picture Parameter Set),etc., of the encoded stream of the end image 173. The sample of the basetrack also has extractors in the unit of samples of the other tracksthan the base track, placed therein, as subsamples. An extractorincludes the type of the extractor and information indicating theposition of the sample of the corresponding track in the file and thesize thereof.

The track whose track ID is 2 is a track that includes slice data of sheleft end image 173-1 of the encoded stream of the end image 173, as asample. The track whose track ID is 3 is a track that includes slicedata of the right end image 173-2 of the encoded stream of the end image173, as a sample.

Example of an Leva Box

The segment structure of the image file of the end image 173 in the casewhere she slice data of the left end image 173-1 and she right end image173-2 are placed on different tracks is the same as the segmentstructure depicted in FIG. 12 except for the leva box. Therefore, onlythe leva box will be described below.

FIG. 16 is a diagram depicting an example of the leva box of the imagefile of the end image 173 in the case where the slice data of the leftend image 173-1 and the right end image 173-2 are placed on differenttracks.

As depicted in FIG. 16, the leva box of the image file of the end image173 in the case where the slice data of the left end image 173-1 and theright end image 173-2 are placed on different tracks has levels “1”through “3” successively set for the tracks having track IDs “1” through“3.”

The leva box depicted in FIG. 16 has track IDs described therein for thetracks including slice data of the region in the end image 173 for whichlevels are set, as information of the respective levels. In the exampledepicted in FIG. 16, the track IDs “1,” “2,” and “3” are describedrespectively as information of levels “1,” “2,” and “3.”

In FIG. 16, the slice data of the encoded stream of the end image 173 asan object for which levels are to be set is placed on a plurality oftracks. Therefore, the assignment_type included in the level informationof each level is 2 or 3 indicating that the object for which levels areto be set is an encoded stream placed on a plurality of tracks.

In FIG. 16, furthermore, there is no Tile Region Group Entrycorresponding to level “1.” Therefore, the type of Tile Region GroupEntry included in the information of level “1” is grouping_type “0”indicating that there is no Tile Region Group Entry. By contrast, TileRegion Group Entry corresponding to levels “2” and “3” is Tile RegionGroup Entry included in the sgpd box. Therefore, the type of Tile RegionGroup Entry included in the information of levels “2” and “3” is “trif”which is the type of Tile Region Group Entry included in the sgpd box.

Another Example of an MPD File

FIG. 17 is a diagram depicting an example of an MPD file where the slicedata of the left end image 173-1 and the right end image 173-2 areplaced on different tracks.

The MPD file depicted in FIG. 17 is the same as the MPD file depicted inFIG. 14 except for the elements of each “SubRepresentation” of the fifth“AdaptationSet.”

Specifically, in the MPD file depicted in FIG. 17, the first“SubRepresentation” of the fifth “AdaptationSet” is “SubRepresentation”of level “2.” Therefore, level “2” is described as an element of“SubRepresentation.”

The track of the track ID “2” corresponding to level “2” has a dependentrelationship to the base track of the track ID “1.” Consequently,dependencyLevel representing the level corresponding to the track in thedependent relationship, which is described as an element of“SubRepresentation,” is set to “1.”

The track of the track ID “2” corresponding to level “2” is HEVC TileTrack. Therefore, codecs representing the type of encoding described asan element of “SubRepresentation” is set to “hvt1.1.2.H93.B0” thatindicates HEVC Tile Track.

In the MPD file depicted in FIG. 17, the second “SubRepresentation” ofthe fifth “AdaptationSet” is “SubRepresentation” of level “3.”Therefore, level “3” is described as an element of “SubRepresentation.”

The track of the track ID “3” corresponding to level “3” has a dependentrelationship to the base track of the track ID “1.” Consequently,dependencyLevel described as an element of “SubRepresentation” is set to“1.”

The track of the track ID “3” corresponding to level “3” is HEVC TileTrack. Therefore, codecs described as an element of “SubRepresentation”is set to “hvt1.1.2.H93.B0.”

As described above, if the left end image 173-1 and the right end image173-2 are encoded as different tiles, then the decoder 194-2 or thedecoder 194-3 depicted in FIG. 10 can decode the left end image 173-1and the right end image 173-2 independently of each other. If the slicedata of the left end image 173-1 and the right end image 173-2 areplaced on different tracks, then either one of the slice data of theleft end image 173-1 and the right end image 173-2 can be acquired.Therefore, the MPD processor 192 can select only one of the left endimage 173-1 and the right end image 173-2 as a selected image.

In the above description, the slice data of the left end image 173-1 andthe right end image 173-2 that are encoded as different tiles are placedon different tracks. However, they may be placed on one track.

In the first and second embodiments, the image of the moving-imagecontent represents an entire celestial sphere image. However, it may bea panoramic image.

Third Embodiment Configurational Example of a Third Embodiment of theInformation Processing System

FIG. 18 is a block diagram depicting a configurational example of athird embodiment of an information processing system to which thepresent disclosure is applied.

Of the configurational details depicted in FIG. 18, those which areidentical to the configurational details depicted in FIG. 1 are denotedby identical reference numerals. Redundant descriptions will be omittedas required.

The configuration of an information processing system 210 depicted FIG.18 is different from the configuration of the information processingsystem 10 depicted in FIG. 1 in that a file generating apparatus 211 isprovided in place of the file generating apparatus 11.

In the information processing system 210, the Web server 12 distributesencoded streams of a mosaic image as an image of a moving-image contentto the moving-image playback terminal 14 according to a processequivalent to MPEG-DASH. The mosaic image refers to an image made up ofthumbnail images of moving images from a plurality of broadcastprograms.

The file generating apparatus 211 of the information processing system210 encodes a mosaic image at a plurality of encoding rates (bit rates),thereby generating encoded streams. The file generating apparatus 211generates image files by converting the encoded streams at therespective encoding rates into files each per time unit called “segment”ranging from several to 10 seconds. The file generating apparatus 211uploads the generated image files to the Web server 12.

The file generating apparatus 211 (setting section) also generates anMPD file (management file) for managing image files, etc. The filegenerating apparatus 211 uploads the MPD file to the Web server 12.

Configurational Example of a File Generating Apparatus

FIG. 19 is a block diagram depicting a configurational example of thefile generating apparatus 211 depicted in FIG. 18.

The file generating apparatus 211 depicted in FIG. 19 includes anencoding processor 231, an image file generator 232, an MPD generator233, and a server uploading processor 234.

The encoding processor 231 of the file generating apparatus 211 encodesa mosaic image as an image of a moving-image content at a plurality ofencoding rates, thereby generating encoded streams. The encodingprocessor 231 supplies the encoded streams at the respective encodingrates to the image file generator 232.

The image file generator 232 converts the encoded streams at therespective encoding rates supplied from the encoding processor 231 intofiles each per segment, thereby generating image files. The image filegenerator 232 supplies the generated image files to the MPD generator233.

The MPD generator 233 determines an URL, etc. of the Web server 12 forstoring the image files supplied from the image file generator 232. TheMPD generator 233 then generates an MPD file containing URLs, etc. ofthe image files. The MPD generator 233 supplies the generated MPD fileand the image files to the server uploading processor 234.

The server uploading processor 234 uploads the image files and the MPDfile supplied from the MPD generator 233 to the Web server 12 depictedin FIG. 18.

Example of a Mosaic Image

FIG. 20 is a diagram depicting an example of a mosaic image.

In the example depicted in FIG. 20, the mosaic image 250 is made up ofan upper left thumbnail image 251, an upper right thumbnail image 252, alower left thumbnail image 253, and a lower right thumbnail image 254.The mosaic image 250 has a resolution of 2 k (1920 pixels×1080 pixels),and all of the thumbnail images 251 through 254 have a resolution of 960pixels×540 pixels.

Example of an Sgpd Box and an Leva Box

The segment structure of the image files of the mosaic image 250depicted in FIG. 20 which is generated by the file generating apparatus211 is the same as the segment structure depicted in FIG. 12 except forthe sgpd box and the leva box. Therefore, only the sgpd box and the levabox will be described below.

FIG. 21 is a diagram depicting an example of an sgpd box and an leva boxof the image files of the mosaic image 250 depicted in FIG. 20.

Since the mosaic image 250 is made up of the four thumbnail images 251through 254, fear Tile Region Group Entries are described in the sgpdbox or the image files of the mosaic image 250, as depicted in FIG. 21.

In the example depicted in FIG. 21, the first Tile Region Group Entrycorresponds to the thumbnail image 251 and is (1,0,0,960,540). Thesecond Tile Region Group Entry corresponds to the thumbnail image 252and is (2,960,0,960,540). The third Tile Region Group Entry correspondsto the thumbnail image 253 and is (3,0,540,960,540). The fourth TileRegion Group Entry corresponds to the thumbnail image 254 and is(4,960,540,960,540).

The leva box has information of levels corresponding to the respectiveTile Region Group Entries described therein successively from theinformation of the level corresponding to the first Tile Region GroupEntry. The level for the thumbnail image 251 is set to 1, the level forthe thumbnail image 252 to 2, the level for the thumbnail image 253 to3, and the level for the thumbnail image 254 to 4.

assignment_type described as the information of each level is set to 0,and the type of Tile Region Group Entry is set to “trif” whichrepresents the type of Tile Region Group Entry described in the sgpdbox.

First Example of an MPD File

FIG. 22 is a diagram depicting a first example of an MPD filecorresponding to the image files of the mosaic image 250 which aregenerated by the file generating apparatus 211 depicted in FIG. 18.

As depicted in FIG. 22, in the MPD file, “AdaptationSet” is describedper encoded stream. Each “AdaptationSet” has “Representation” describedtherein, and “Representation” has the URL “stream.mp4” of the imagefiles of the encoded streams of the mosaic image 250 described therein.Since levels are set for the encoded streams of the mosaic image 250,“SubRepresentation” per level can be described in “Representation.”

Therefore, the “SubRepresentation” of level “1” has<SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,0,0,960,540,1920,1080”/> which represents the SRD of thethumbnail image 251 described therein. The SRD of the thumbnail image251 is thus set in association with the position on the mosaic image 250of the thumbnail image 251 indicated by the Tile Region Group Entrycorresponding to level “1.”

The “SubRepresentation” of level “2” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,960,0,960,540,1920,1080”/>which represents the SRD of the thumbnail image 252 described therein.The SRD of the thumbnail image 252 is thus set in association with theposition on the mosaic image 250 of the thumbnail image 252 indicated bythe Tile Region Group Entry corresponding to level “2.”

The “SubRepresentation” of level “3” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0,540,960,540,1920,1080”/>which represents the SRD of the thumbnail image 253 described therein.The SRD of the thumbnail image 253 is thus set in association with theposition on the mosaic image 250 of the thumbnail image 253 indicated bythe Tile Region Group Entry corresponding to level “3.”

The “SubRepresentation” of level “4” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,960,540,960,540,1920,1080”/> which represents the SRD of thethumbnail image 254 described therein. The SRD of the thumbnail image254 is thus set in association with the position on the mosaic image 250of the thumbnail image 254 indicated by the Tile Region Group Entrycorresponding to level “4.”

As described above, in the MPD file depicted in FIG. 22, the horizontaland vertical sizes of the mosaic image 250 indicated by Tile RegionGroup Entry are identical to the horizontal and vertical sizes of thescreen indicated by the SRD. The horizontal and vertical coordinates onthe mosaic image 250 indicated by Tile Region Group Entry correspondingto each level are identical to the horizontal and vertical positions onthe screen indicated by the SRD corresponding to the level. When the MPDfile depicted in FIG. 22 is generated, therefore, the screen where thethumbnail images 251 through 254 decoded on the basis of the SRDs areplaced is identical to the mosaic image 250.

The “SubRepresentation” of each level also has URLs of moving imagescorresponding to the thumbnail images 251 through 254 of the leveldescribed therein. Specifically, the “SubRepresentation” of level “1”has the URL “http://example.com/a_service/my.mpd” of the moving imagecorresponding to the thumbnail image 251 described therein. The“SubRepresentation” of level “2” has the URL“http://example.com/b_service/my.mpd” of the moving image correspondingto the thumbnail image 252 described therein.

The “SubRepresentation” of level “3” has the URL“http://example.com/c_service/my.mpd” of the moving image correspondingto the thumbnail image 253 described therein. The “SubRepresentation” oflevel “4” has the URL “http://example.com/d_service/my.mpd” of themoving image corresponding to the thumbnail image 254 described therein.

Second Example of an MPD File

FIG. 23 is a diagram depicting a second example of an MPD filecorresponding to the image files of the mosaic image 250 which aregenerated by the file generating apparatus 211 depicted in FIG. 18.

The MPD file depicted in FIG. 23 is different from the MPD file depictedin FIG. 22 only with respect to an SRD described in the“SubRepresentation” of each level.

Specifically, an the MPD file depicted in FIG. 23, the“SubRepresentation” of level “3” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0,0,960,540,1920,1080”/>which represents the SRD of the thumbnail image 253 described therein.

The “SubRepresentation” of level “4” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,960,0,960,540,1920,1080”/>which represents the SRD of the thumbnail image 254 described therein.

The “SubRepresentation” of level “1” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0,540,960,540,1920,1080”/>which represents the SRD of the thumbnail image 251 described therein.

The “SubRepresentation” of level “2” has <SupplementalPropertyschemeIdUri=“urn:mpeg:dash:srd:2014”value=“1,960,540,960,540,1920,1080”/> which represents the SRD of thethumbnail image 252 described therein.

As described above, in the MPD file depicted in FIG. 23, as with the MPDfile depicted in FIG. 22, the horizontal and vertical sizes of themosaic image 250 indicated by Tile Region Group Entry are identical tothe horizontal and vertical sizes of the screen indicated by the SRD.

However, the horizontal and vertical coordinates on the mosaic image 250indicated by Tile Region Group Entry corresponding to each level, aredifferent from the horizontal and vertical positions on the screenindicated by the SRD corresponding to the level. When the MPD filedepicted in FIG. 23 is generated, therefore, the screen where thethumbnail images 251 through 254 decoded on the basis of the SRDs areplaced is different from the mosaic image 250.

Example of a Screen where Thumbnail Images Site Placed

FIG. 24 is a diagram depicting an example of a screen where thethumbnail images 251 through 254 decoded on the basis of the SRDsdescribed in the MPD file depicted in FIG. 23 are placed.

The SRD of the thumbnail image 251 described in the MPD file depicted inFIG. 23 indicates that the coordinates of an upper left corner of thethumbnail image 251 on a screen 270 of 1920 pixels×1080 pixels are(0,540). Therefore, as depicted in FIG. 24, the thumbnail image 251 isplaced in a lower left area of the screen 270.

The SRD of the thumbnail image 252 indicates that the coordinates of anupper left corner of the thumbnail image 252 on the screen 270 are(960,540). Therefore, as depicted in FIG. 24, the thumbnail image 252 isplaced in a lower right area of the screen 270.

The SRD of the thumbnail image 253 indicates that the coordinates of anupper left corner of the thumbnail image 253 on the screen 270 of 1920pixels×1080 pixels are (0,0). Therefore, as depicted in FIG. 24, thethumbnail image 253 is placed in an upper left area of the screen 270.

The SRD of the thumbnail image 254 indicates that the coordinates of anupper left corner of the thumbnail image 254 on the screen 270 are(960,0). Therefore, as depicted, in FIG. 24, the thumbnail image 254 isplaced in an upper right, area of the screen 270.

As described above, with the MPD file depicted in FIG. 23, the layout ofthe thumbnail images 251 through 254 can be changed from the layout inthe mosaic image 250 to be encoded to the layout in the screen 270 atthe time they are displayed.

Description of a Process of the File Generating Apparatus

FIG. 25 is a flowchart of a file generating process of the filegenerating apparatus 211 depicted in FIG. 19.

In step S191 depicted in FIG. 25, the encoding processor 231 encodes amosaic image as an image of a moving-image content at a plurality ofencoding rates, thereby generating encoded streams. The encodingprocessor 231 supplies the encoded streams at the respective encodingrates to the image file generator 232.

In step S192, the image file generator 232 converts the encoded streamsat the respective encoding rates supplied from the encoding processor231 into files each per segment, thereby generating image files. Theimage file generator 232 supplies the generated image files to the MPDgenerator 233.

In step S193, the MPD generator 233 generates an MPD file containingURLs, etc. of the image files. The MPD generator 233 supplies thegenerated MPD file and the image flies to the server uploading processor234.

In step S194, the server uploading processor 234 uploads the image filesand the MPD file supplied from the MPD generator 233 to the Web server12. The process now comes to an end.

Functional Configurational Example of a Moving-Image Playback Terminal

FIG. 26 is a block diagram depicting a configurational example of astreaming player implemented by the moving-image playback terminal 14depicted in FIG. 18 when it executes the control software 21, themoving-image playback software 22, and the access software 23.

Of the configurational details depicted in FIG. 26, those which areidentical to the configurational details depicted in FIG. 10 are denotedby identical reference numerals. Redundant descriptions will be omittedas required.

A streaming player 230 depicted in FIG. 26 includes an MPD acquirer 191,an MPD processor 292, an image file acquirer 293, a decoder 294, adisplay controller 295, an acceptor 296, and a moving image acquirer297.

The MPD processor 292 of the streaming player 290 extracts informationsuch as URLs, etc. of the image files of segments to be played from theMPD file supplied from the MPD acquirer 191, and supplies the extractedinformation to the image file acquirer 293. The MPD processor 292 alsosupplies the MPD file to the moving image acquirer 297. The MPDprocessor 292 extracts the SRDs of the divided images of a mosaic imageof the segments to be played from the MPD file, and supplies theextracted SRDs to the display controller 295.

The image file acquirer 293 requests the Web server 12 for the encodedstreams of the image files that are specified by the URLs supplied fromthe MPD processor 292, and acquires the encoded streams. The image fileacquirer 293 supplies the acquired encoded stream to the decoder 294.

The decoder 294 decodes the encoded streams supplied from the image fileacquirer 293. The decoder 294 supplies a mosaic image obtained as aresult of the decoding process to the display controller 295.

The display controller 295 (allocator) places the divided images of themosaic image supplied from the decoder 294 on the screen on the basis ofthe SRDs supplied from the MPD processor 292. The display controller 235superposes a cursor on the screen where the divided images are placed,and supplies the divided images with the superposed cursor to a displaydevice, not depicted, which displays them.

In response to an instruction to enlarge a given region of the screensupplied from the acceptor 296, the display controller 295 enlarges thesize of a partial mosaic image, of the screen where the mosaic image isplaced, that includes only a thumbnail image contained in the region, upto the size of the screen. The display controller 295 superposes acursor on the given thumbnail image in the screen where the enlargedpartial mosaic image is placed, and supplies the thumbnail image withthe superposed cursor to the display device, not depicted which displaysthem.

The display controller 295 supplies a moving image, supplied from themoving image acquirer 297, that corresponds to one of the thumbnailimages being displayed, to the display device, not depicted, whichdisplays the supplied moving image.

The acceptor 296 accepts an instruction from the user, etc. and suppliesthe instruction to the moving image acquirer 297 or the displaycontroller 295.

In response to an instruction about a position supplied from theacceptor 296, the moving image acquirer 297 acquires the URL of a movingimage corresponding to the position from the MPD file supplied from theMPD processor 292. The moving image acquirer 297 acquires a moving imagefrom the Web server 12 or the like on the basis of the acquired URL, andsupplies the acquired moving image to the display controller 295.

Outline of a Playback Process

FIG. 27 is a diagram illustrative of an outline of a playback process ofthe streaming player 290 depicted in FIG. 26.

As depicted in a left section of FIG. 27, the display controller 295puts a cursor 312 on a given thumbnail image 311 of 4×4 thumbnail images311 that make up a mosaic image 310 placed in the screen, and controlsthe display device, not depicted, to display the given thumbnail image311.

At this time, the user gives an instruction to enlarge a desired regionwhile seeing the screen of the mosaic image 310 with the cursor 312superposed thereon. In the example depicted in FIG. 27, the user givesan instruction to enlarge the region of 2×2 thumbnail images 311 in anupper right area of the screen where the mosaic image 310 is placed.

In response to the enlarging instruction, the display controller 295enlarges the size of a partial mosaic image 313 which is made up of onlythe 2×2 thumbnail images 311, of the screen where the mosaic image 310is placed, to the size of the screen. Then, as depicted in a centralsection of FIG. 27, the display controller 295 superposes a cursor 314on a given thumbnail image 311 in the screen where the enlarged partialmosaic image 313 is placed, and controls the display device, notdepicted, to display the thumbnail image 311.

At this time, the user moves the cursor 314 to a desired thumbnail image311 and performs an action such as a double tap or the like thereon,indicating a position for the cursor 314, In the example depicted inFIG. 27, the user indicates the position of an upper right thumbnailimage 311.

In response to the user's instruction, the moving image acquirer 297acquires the URL of the moving image corresponding to the SRD thatindicates the position on the screen of the mosaic image 310corresponding to the position on the indicated partial mosaic image 313,from the MPD file, as the URL of a moving image corresponding to theindicated position. Then, based on the acquired URL, the moving imageacquirer 297 acquires a moving image 315 from the Web server 12 or thelike, and supplies the acquired moving image 315 to the displaycontroller 295. As depicted in a right section of FIG. 27, the displaycontroller 295 controls the display device, not depicted, to display themoving image 315.

Description of a Process of the Moving-Image Playback Terminal

FIG. 28 is a flowchart of a playback process of the streaming player 290depicted in FIG. 26.

In step S211 depicted in FIG. 28, the MPD acquirer 191 of the streamingplayer 290 acquires the MPD file from the Web server 12 and supplies theacquired MPD file to the MPD processor 292.

In step S212, the MPD processor 292 extracts information such as URLs,etc. of the image files of segments to be played from the MPD filesupplied from the MPD acquirer 191, and supplies the extractedinformation to the image file acquirer 293. The MPD processor 292 alsosupplies the MPD file to the moving image acquirer 297. The MPDprocessor 292 extracts the SRDs of the divided images of a mosaic imageof the segments to be played from the MPD file, and supplies theextracted SRDs to the display controller 295.

In step S213, the image file acquirer 293 requests the Web server 12 forthe encoded streams of the image files that are specified by the URLssupplied from the MPD processor 292, and acquires the encoded streams.The image file acquirer 293 supplies the acquired encoded stream to thedecoder 294.

In step S214, the decoder 294 decodes the encoded streams supplied fromthe image file acquirer 293. The decoder 294 supplies a mosaic imageobtained as a result of the decoding process to the display controller295.

In step S215, the display controller 295 places the divided images ofthe mosaic image from the decoder 294 on the screen OR the basis of theSRDs from the MPD processor 292, superposes a cursor or the like on thescreen, and supplies the divided images with the superposed cursor tothe display device, not depicted, which displays them.

In step S216, the acceptor 296 determines whether it has accepted aninstruction to enlarge a given region of the screen from the user ornot. If the acceptor 296 decides that it has not accepted an instructionto enlarge a given region of the screen from the user in step S216, thenthe acceptor 296 waits until it accepts an instruction to enlarge agiven region of the screen.

If the acceptor 296 decides that it has accepted an instruction toenlarge a given region of the screen from the user in step S216, thenthe acceptor 296 supplies the enlarging instruction to the displaycontroller 295. In step S217, in response to the enlarging instructionsupplied from the acceptor 296, the display controller 295 enlarges thesize of a partial mosaic image, of the screen where the mosaic image isplaced, that includes only a thumbnail image contained in the regioninstructed to be enlarged, up to the size of the screen.

In step S218, the display controller 295 superposes a cursor or the likeon a given thumbnail image in the screen where the enlarged partialmosaic image is placed, supplies the thumbnail image with the superposedcursor to the display device, not depicted, which displays them. At thistime, the user moves the cursor to a desired thumbnail image andperforms an action such as a double tap or the like thereon, indicatinga position for the cursor on the screen.

In step S219, the acceptor 296 determines whether it has accepted aninstruction for a position on the screen from the user or not. If theacceptor 296 decides that it has not accepted an instruction for aposition on the screen in step S219, then the acceptor 296 waits untilit accepts an instruction for a position on the screen.

If the acceptor 296 decides that it has accepted an instruction for aposition on the screen in step S219, then the acceptor 296 supplies theinstruction to the moving image acquirer 297. In step S220, in responseto the instruction from the acceptor 296, the moving image acquirer 297acquires the URL of a moving image corresponding to the indicatedposition from the MPD file supplied from the MPD processor 292.

In step S221, the moving image acquirer 297 acquires a moving image fromthe Web server 12 or the like on the basis of the acquired URL, andsupplies the acquired moving image to the display controller 295.

In step S222, the display controller 295 supplies the moving imagesupplied from the moving image acquirer 297 to the display device, notdepicted, which displays it. The process is now ended.

In the third embodiment, a partial mosaic image is displayed after amosaic image has been displayed, and a position on the partial mosaicimage is indicated by the user. However, a partial mosaic image say notbe displayed, and a position on the mosaic image may be indicateddirectly by the user.

Fourth Embodiment Description of a Computer to which the PresentDisclosure is Applied

The above sequence of processes may be hardware-implemented orsoftware-implemented. If the sequence of processes issoftware-implemented, then software programs are installed in acomputer. The computer may be a computer incorporated in dedicatedhardware or a general-purpose personal computer which is capable ofperforming various functions by installing various programs.

FIG. 29 is a block diagram depicting a configurational example of thehardware of a computer that executes the above sequence of processesbased on programs.

A computer 900 includes a CPU (Central Processing Unit) 901, a ROM (ReadOnly Memory) 902, and a RAM (Random Access Memory) 903 that areconnected to each other by a bus 904.

An input/output interface 905 is connected to the bus 904. To theinput/output interface 905, there are connected an input unit 906, anoutput unit 907, a storage unit 908, a communication unit 909, and adrive 910.

The input unit 906 includes a keyboard, a mouse, and a microphone, etc.The output unit 907 includes a display and a speaker, etc. The storageunit 908 includes a hard disk and a non-volatile memory, etc. Thecommunication unit 909 includes a network interface, etc. The drive 910works on a removable medium 911 such as a magnetic disk, an opticaldisk, a magneto-optical disk, a semiconductor memory, or the like.

In the computer 900 thus constructed, the CPU 901 loads programs storedin the storage unit 908, for example, through the input/output interface905 and the bus 904 into the RAM 903 and executes the programs toperform the processes described above.

The programs run by the computer 900 (the CPU 901) can be recorded onand provided by the removable medium 911 as a package medium or thelike, for example. The programs can also be provided through a wired orwireless transmission medium such as a local area network, the Internet,or a digital satellite broadcast.

In the computer 900, the programs can be installed in the storage unit908 through the input/output interface 905 when the removable medium 911is inserted into the drive 910. The programs can also be received by thecommunication unit 909 through a wired or wireless transmission mediumand installed in the storage unit 908. The programs can alternatively bepre-installed in the ROM 902 or the storage unit 908.

The programs that are executed by the computer 900 may be programs inwhich processes are carried out in chronological order in the sequencedescribed above, or may be programs in which processes are carried outparallel to each other or at necessary timings as when called for.

In the present specification, the term “system” means a collection ofcomponents (apparatus, modules (parts), or the like), and it does notmatter whether all the components are present in the same housing ornot. Therefore, both a plurality of apparatus housed in each housing andconnected by a network, and a single apparatus having a plurality ofmodules housed in one housing may be referred to as a system.

The advantages referred to above in the present specification are onlyillustrative, but not limitative, do not preclude other advantages.

The embodiments of the present disclosure are not limited to the aboveembodiments, and various changes may be made therein without departingfrom the scope of the present disclosure.

The present disclosure may be presented in the following configurations:

(1)

An information processing apparatus including:

a setting section that sets a position protruding out of a screen as aposition on the screen of an image made up of a plurality of dividedimages compatible with encoded streams.

(2)

The information processing apparatus according to (1), in which theplurality of divided images are images of facing ends which are part ofan entire celestial sphere image or a panoramic image.

(3)

The information processing apparatus according to (1) or (2), in whichthe setting section sets the position of the image on the screen in amanagement file for managing files of the encoded streams.

(4)

An information processing method including:

a setting step that sets a position protruding out of a screen as aposition on the screen of an image made up of a plurality of dividedimages compatible with encoded streams in an information processingapparatus.

(5)

An information processing apparatus including: an allocator that placesan image obtained by decoding encoded streams on a screen, on the basisof a position protruding out of the screen which is set as a position onthe screen of the image which is made up of a plurality of dividedimages compatible with the encoded streams.

(6)

The information processing apparatus according to (5), in which theplurality of divided images are images of facing ends which are part ofan entire celestial sphere image or a panoramic image.

(7)

The information, processing apparatus according to (5) or (6), in whichthe position of the image on the screen is set in a management file formanaging files of the encoded streams.

(8)

An information processing method including:

an allocating step that places an image obtained by decoding encodedstreams on a screen, on the basis of a position protruding out of thescreen which is set as a position on the screen of the image which ismade up of a plurality of divided images compatible with the encodedstreams in an information processing apparatus.

(9)

An information processing apparatus including:

a setting section that sets positions on a screen of respective dividedimages of an image which is made up of a plurality of divided imagescompatible with encoded streams, in association with positions of thedivided images on the image.

(10)

The information processing apparatus according to (9), in which theimage is part of an entire celestial sphere image or a panoramic image,or a mosaic image.

(11)

The information processing apparatus according to (9) or (10), in whichthe encoded streams are encoded streams representing the divided imagesencoded as different tiles.

(12)

The information processing apparatus according to any one of (9) through(11), in which the setting section sets the position of the image on thescreen in a management file for managing files of the encoded streams.

(13)

An information processing method including:

a setting step that sets positions on a screen of respective dividedimages of an image which is made up of a plurality of divided imagescompatible with encoded streams, in association with positions of thedivided images on the image in an information processing apparatus.

(14)

An information processing apparatus including:

an allocator that places divided images of an image obtained by decodingencoded streams on a screen, on the basis of positions on the screen ofthe divided images of the image which are set in association withpositions on the image which is made up of a plurality of divided imagescompatible with the encoded streams.

(15)

The information processing apparatus according to (14), in which theimage is part of an entire celestial sphere image or a panoramic image,or a mosaic image.

(16)

The information processing apparatus according to (14) or (15), in whichthe encoded streams are encoded streams representing the divided imagesencoded as different tiles.

(17)

The information processing apparatus according to any one of (14)through (16), in which the position of the image on the screen is set ina management file for managing files of the encoded streams.

(18)

An information processing method including:

an allocating step that places divided images of an image obtained bydecoding encoded streams on a screen, on the basis of positions on thescreen of the divided images of the image which are set in associationwith positions on the image which is made up of a plurality of dividedimages compatible with the encoded streams in an information processingapparatus.

REFERENCE SIGNS LIST

11 File generating apparatus, 14 Moving-image playback terminal, 170Entire celestial sphere image, 173-1 Left end image, 173-2 Right endimage, 180 Screen, 195 Allocator, 211 File generating apparatus, 250Mosaic image, 251 Through 254 Thumbnail image.

The invention claimed is:
 1. An information processing apparatuscomprising: circuitry configured to request partial images related to animage obtained by dividing an entire celestial sphere image or apanoramic image into a plurality of partial images including therequested partial images, receive an encoded stream such that a firstrequested partial image of the plurality of partial images constitutinga first end portion and a second requested partial image of theplurality of partial images opposite to the first requested partialimage comprise one continuous image among the plurality of partialimages, and decode information of a position of the one continuous imagewith respect to the entire celestial sphere image or the panoramic imagewhen at least one of the first requested partial image or the secondrequested partial image is out of the range of the entire celestialsphere image or the panoramic image.
 2. The information processingapparatus according to claim 1, wherein the circuitry decodes theinformation of the position of the one continuous image on a screenusing a management file for managing files of the encoded stream.
 3. Aninformation processing method, executed via at least one processor, themethod comprising: requesting partial images related to an imageobtained by dividing an entire celestial sphere image or a panoramicimage into a plurality of partial images including the partial images;receiving an encoded stream such that a first requested partial image ofthe plurality of partial images constituting a first end portion and asecond requested partial image of the plurality of partial imagesopposite to the first requested partial image comprise one continuousimage among the plurality of partial images; and decoding information ofa position of the one continuous image with respect to the entirecelestial sphere image or the panoramic image when at least one of thefirst requested partial image and the second requested partial image isout of the range of the entire celestial sphere image or the panoramicimage.
 4. An information processing apparatus comprising: circuitryconfigured to request partial images related to an image obtained bydividing an entire celestial sphere image or a panoramic image into aplurality of partial images including the requested partial images,receive an encoded stream such that a first requested partial image ofthe plurality of partial images constituting a first end portion and asecond requested partial image of the plurality of partial imagesopposite to the first requested partial image comprise one continuousimage among the plurality of partial images, and output one or more ofthe requested partial images of the image obtained by decoding theencoded stream on a screen, on the basis of a position of the onecontinuous image with respect to the entire celestial sphere image orthe panoramic image.
 5. The information processing apparatus accordingto claim 4, wherein the position of the one continuous image on thescreen is set in a management file for managing files of the encodedstream.
 6. An information processing method, executed via at least oneprocessor, the method comprising: requesting partial images related toan image obtained by dividing an entire celestial sphere image or apanoramic image into a plurality of partial images including therequested partial images; receiving an encoded stream such that a firstrequested partial image of the plurality of partial images constitutinga first end portion and a second requested partial image of theplurality of partial images opposite to the first requested partialimage comprise one continuous image among the plurality of partialimages; and outputting one or more of the requested partial images ofthe image obtained by decoding the encoded stream on a screen, on thebasis of a position protruding out of the screen which is set as aposition of the one continuous image with respect to the entirecelestial sphere image or the panoramic image.
 7. An informationprocessing apparatus comprising: circuitry configured to request partialimages related to an image obtained by dividing an entire celestialsphere image or a panoramic image into a plurality of partial imagesincluding the requested partial images, generate an encoded stream suchthat a first requested partial image of the plurality of partial imagesconstituting a first end portion and a second requested partial image ofthe plurality of partial images opposite to the first requested partialimage comprise one continuous image among the plurality of partialimages, and decode information of positions on a screen of respectivepartial images of the plurality of partial images, including informationof a position of the one continuous image with respect to the entirecelestial sphere image or the panoramic image.
 8. The informationprocessing apparatus according to claim 7, wherein the encoded streamcomprises the requested partial images encoded as different tiles. 9.The information processing apparatus according to claim 7, wherein thecircuitry decodes information of the position of the one continuousimage on the screen using a management file for managing files of theencoded stream.
 10. An information processing method, executed via atleast one processor, the method comprising: requesting partial imagesrelated to an image obtained by dividing an entire celestial sphereimage or a panoramic image into a plurality of partial images includingthe requested partial images; receiving an encoded stream such that afirst requested partial image of the plurality of partial imagesconstituting a first end portion and a second requested partial image ofthe plurality of partial images opposite to the first requested partialimage comprise one continuous image among the plurality of partialimages; and decoding information of positions on a screen of respectivepartial images of the plurality of partial images, including informationof a position of the one continuous image with respect to the entirecelestial sphere image or the panoramic image.
 11. An informationprocessing apparatus comprising: circuitry configured to to requestpartial images related to an image obtained by dividing an entirecelestial sphere image or a panoramic image into a plurality of partialimages including the requested partial images, receive an encoded streamsuch that a first requested partial image of the plurality of partialimages constituting a first end portion and a second requested partialimage of the plurality of partial images opposite to the first requestedpartial image comprise one continuous image among the plurality ofpartial images, and output one or more of the requested partial imagesof the image obtained by decoding the encoded stream on a screen, on thebasis of positions on the screen of the plurality of partial images,including a position of the one continuous image with respect to theentire celestial sphere image or the panoramic image.
 12. Theinformation processing apparatus according to claim 11, wherein theencoded stream comprises the requested partial images encoded asdifferent tiles.
 13. The information processing apparatus according toclaim 11, wherein the position of the one continuous image on the screenis set in a management file for managing files of the encoded stream.14. An information processing method, executed via at least oneprocessor, the method comprising: requesting partial images related toan image obtained by dividing an entire celestial sphere image or apanoramic image into a plurality of partial images including therequested partial images; receiving an encoded stream such that a firstrequested partial image of the plurality of partial images constitutinga first end portion and a second requested partial image of theplurality of partial images opposite to the first requested partialimage comprise one continuous image among the plurality of partialimages; and outputting one or more of the requested partial images ofthe image by decoding the encoded stream on a screen, on the basis ofpositions on the screen of the plurality of partial images, including aposition of the one continuous image with respect to the entirecelestial sphere image or the panoramic image.